#reasoning benchmarks

OpenThoughts introduces a scalable supervised fine-tuning pipeline that significantly enhances reasoning datasets and models, achieving state-of-the-art performance in math, coding, and science domains.

‘Selective training on high-entropy tokens in LLMs improves reasoning performance and reduces computational costs, setting new benchmarks on AIME tests.’